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Abstract — This technical report introduces some software packages for partial SVD computation, including optimized PROPACK, 
modified PROPACK for computing singular values above a threshold and the corresponding singular vectors, and block Lanczos with 
warm start (BLWS). The current version is preliminary. The details will be enriched soon. 
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1 Introduction 

This technical report introduces some software pack- 
ages for partial SVD computation, including optimized 
PROPACK, modified PROPACK for computing singular 
values above a threshold and the corresponding singular 
vectors, and block Lanczos with warm start (BLWS). 
The current version is preliminary. The details will be 
enriched soon. 

2 Optimized PROPACK 

PROPACK [3j is nowadays widely used in 
solving nuclear norm minimization problems in 
order to compute the partial SVD. We optimized 
PROPACK and obtained 15% to 20% speed 
up. The optimization is mainly by rewriting 
the Gram-Schmidt orthogonalization in the 
Lanczos procedure. The code is downloadable at 
|http: / /research.microsoft.com/ ~zhoulin/ optPROPACK.zip 



Algorithm 1 Partial SVD by a Threshold 

l: Input: Matrix A, threshold svthr, initial vector po, 
size K of the bidiagonal matrix B, fi\ = \\po\\, Ui = 
Po/Pir i = 1/ minsv = svthr + 1, 
2: while minsv > svthr do 
3: while i < K do 

4: n = A T Ui - PiVi-u n = reorth(ri), 

5: Oi = WnW, Vi = n/ai, 

6: pi = Av.i - aiU t , pi = reorth(pi), 

7: i <- 1 + 1. 

8: end while 

9: Compute the SVD of the bidiagonal matrix B to 

obtain the singular values, stored in a vector s. 
10: neig = the number of accurate singular values. 
11: minsv = the minimum of those accurate singular 

values. 
12: Update K by 



3 Modified PROPACK 

The current PROPACK |3) can only output given number 
of principal singular values and vectors. However, when 
solving nuclear norm minimization problems, we are 
often faced with singular value thresholding (J), which 
requires the principal singular values that are greater 
than a given threshold. So we modified PROPACK to 
provide this functionality The pseudo code is as in 
Algorithm Q] 0. 

The code is downloadable at 



min(K + 100, max(2 + A", 
K = { length(s > svthr) * K/neig)), 
2 * A", 



if neig > 0, 
otherwise. 



13: end while 



However, the matrix to compute the partial SVD 
only changes slightly over iteration. To utilize this 
fact, we propose using the block Lanczos with 
warm start technique to cut the computation in 
each iteration (5). The code is downloadable at 
http : / / research.microsoft.com/~zhoulin/BLWS.zip| 



|htrp://research.microsoft.com/-zhoulin/ThresholdLANSVDyfp code deludes the BLWS technique for eigenvalue 

decomposition (BL_EVD.m) and that for singular value 
decomposition (BL_SVD.m), and also an exemplary us- 

4 Block Lanczos with Warm Start age of bl_svd in solving the rpc a problem ffl. 
(BLWS) 



When solving nuclear norm minimization problems, 
we have to solve the partial SVD multiple times. 
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